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HANDWRITING TRAJECTORY RECOGNITION SYSTEM AND METHOD 

5 CROSS-REFERENCE TO RELATED APPLICATIONS 

[01] This application claims the benefit of Korean Patent Application No. 

2003-16413, dated March 17, 2003, in the Korean Intellectual Property Office, the 
disclosure of which is incorporated herein by reference. 
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BACKGROUND 

1. Field 

[02] This disclosure teaches techniques related to a handwriting trajectory 

recognition system, and more particularly, to techniques for recognizing handwriting 
15 trajectory in three-dimensional space. 

2. Description of the Related Art 

[03] Recently the markets for personal mobile devices such as PDAs, cellular 

phones, notebooks, and so on, have increased. It can be stated that such personal 

20 mobile devices are most fit for ubiquitous environments since they are easy to carry and 
used for information utilization anytime and anywhere. That is, the recent mobile 
devices enable users to utilize information during their movements so that the users can 
use information any time and anywhere, unlike the past environments confining 
information utilization to immobile devices such as desktop personal computers (PCs) 

25 installed at homes. 

[04] However, while such mobile devices have been made smaller for 

convenience in carrying, they have become inconvenient in recognizing information and 
inputting commands through the display part of the devices. In such mobile devices, 
making it easy to carry runs counter to being easy to input and output information. 

30 Therefore, researches and developments have been continuously made on methods for 
overcoming the problems. 
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[05] Recently, a pen-type input system has emerged as a means through 

which users use the mobile devices more conveniently. A general pen-type input 
system is designed to recognize writing trajectory or selection motions which are input 
through a two-dimensional plane of an input pad so that the a mobile device displays 
5 writing trajectories on a display unit or performs corresponding operations based on 
recognized information. 

[06] Fig. 1 is a view for showing an input style for a conventional pen-type 

input system. The pen-type input system has a stylus pen part 10 held in a user's hand 
so that a user can make writing or selecting motions with it. It further includes a display 

10 part 22, which may be a PDA 20, for example, that recognizes menu selection 

commands and/or writing trajectories from a contact state of a portion of the stylus pen 
part 10 on the two-dimensional plane of the display part 22. The display part displays 
corresponding operations based on a selected menu or handwritings. Herein, the pen 
part 10 operates as a pointing tool or handwriting tool without an extra power supply, 

15 and the PDA 20 processes a signal corresponding to a portion of the display part 22 on 
which the tip portion of the pen part 10 is placed. 

[07] The pen-type input system as above decides what information is input 

depending upon positions where the pen part 10 is in contact with the two-dimensional 
plane of the display part 22. That is, if a current view displayed on the display part 22 is 

20 a view displaying menus, the PDA 20 decides information corresponding to a position 
where the tip portion of the pen part 10 is in contact with as menu selection information. 
It then executes a corresponding command based on information on the selected 
position. Further, the PDA 20 obtains information on contact positions of the pen part 
10 that are continuously changing, if a view capable of recognizing handwritings is 

25 displayed. It then displays on the view of the display part 22 the handwriting trajectory 
from the obtained information. 

[08] The above pen-type input system can more precisely recognize 

handwritings since a user writes on the display part of two-dimension plane. However, 
the user must perform his or her menu selections or writing motions within a limited 
30 view of the display part 22, which still causes inconvenience in inputting users' input 
motions. 

[09] In order to solve the above problem, systems having motion-detecting 

sensors inside the pen part 10 and detecting through the sensors users' handwriting 
trajectories in the three-dimensional space have been proposed in U.S. Patent No. 



2 



6,181,329 (laid-open Jan. 30, 2001) and U.S. Patent No. 6,212,296 (laid-open April 3, 
2001). 

[10] The Pen-type input systems disclosed in the U.S. Patent Nos. 6,181,329 

and 6,212,296 can recognize writing motions carried out in the three-dimensional space 
5 so that a user can input information without any limit to a writing area. However, these 
systems have a problem that there exists a high possibility of causing recognition errors 
since consonants and vowels or diverse symbols such as alphabets and the like are 
continuously generated when users make writing motions in the three-dimensional 
space. When most people make writing motions, they write consonants and vowels or 

10 symbols such as alphabets and the like in stroked lines separately from each other in 

order for third parties to more easily grasp the handwritings. While, the above pen-type 
input system using the writing plane interprets high-frequency signals based on frictions 
between the pen and the writing plane to recognize stroked lines for consonants, vowels, 
symbols such as alphabets and the like, the pen-type input system recognizing writing 

1 5 motions in three-dimensional space cannot recognize stroke lines any more since those 
lines are continuous in the three-dimensional space. Accordingly, when needed to 
display on a display unit writing trajectories based on writing motions in the three- 
dimensional space, the system can display only continuous handwriting trajectories that 
are different from users' intents. This causes a problem since a third party has 

20 difficulties in recognizing information. 

[11] However, techniques are unavailable for segmenting strokes into only symbols 
for pure writings with respect to symbols based on writing motions in space without an 
extra writing plane and recognizing only the symbols for pure writings. 

25 SUMMARY 

[12] The disclosed teachings are aimed to overcoming some of the problems 

discussed above. There is provided a handwriting trajectory recognition system, 
comprising a motion detection unit adapted to output electric signals based on changes 
in acceleration of a body of the system in space. A control unit adapted to detect non- 
30 stroke regions intervals where the motions of the system body are temporarily stopped 
and recover handwritings based on the electric signals is provided. 
[13] Another aspect of the disclosed teachings is a handwriting trajectory recognition 
method comprising detecting changes in acceleration of a body of the system in space. 
Non-stroke regions are detected if there exist intervals where motions of the system 
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body are temporarily stopped. Handwritings are recovered by the system body based on 
decision results. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 [14] The disclosed teachings will be described in detail with reference to the 

following drawings in which like reference numerals refer to like elements. 
[15] Fig. 1 is a view for showing an input style for a conventional pen-type 

input system. 

[16] Fig. 2 is a schematic block diagram for showing an exemplary 

10 handwriting trajectory recognition system according to some aspects of the disclosed 
teachings. 

[17] Fig. 3 shows typical shifts of standard deviation of accelerations, and 

acceleration magnitudes. 

[18] Fig. 4 shows simulation results in which the handwriting trajectory 

15 recognition system of FIG. 2 recognizes and displays strokes of "Samsung" written in 
space by using a pen-like body. 

DETAILED DESCRIPTION 

[19] Te disclosed teachings will be described in detail herein with reference to 

20 the accompanying drawings. 

[20] Fig. 2 is a schematic block diagram showing an exemplary handwriting 

trajectory recognition system embodying some aspects of the disclosed teachings. The 
recognition system 100 has a motion detection unit 1 10, a display unit 120, a 
transmission/reception unit 130, and a control unit 140. 

25 [21] The motion detection unit 1 10 continuously detects acceleration changes 

and position changes of a body of the system 100. The motion detection unit 1 10 is 
structured with plural gyro sensors, plural acceleration sensors for detecting the motion. 
It further includes a computing circuit for performing computing operations with 
electric signals transferred from respective sensors. 

30 [22] The display unit 120 displays the motions of the body on its screen. The 

display unit 120 may be built in the recognition system 100 to be incorporated into one 
body. Alternately, the displayable unit could be in a different system. 
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[23] The transmission/reception unit 130 communicates motion information 

recognized under the controls of the control unit 140 and control signals corresponding 
to the motion information with other external systems. 

[24] The control unit 140 receives acceleration changes and position changes 

5 of the body, which are detected from the motion detection unit 1 10. It recognizes 
handwriting trajectory in the three-dimensional space made by a user based on 
information on the acceleration and position changes occurring as the body is moved. 
At this time, the control unit 140 decides as non-stroke regions temporary stop regions 
of system body motions based on the information on the detected motions of the system 

10 body, and recovers the handwriting trajectory. 

[25] In here, the stroked lines can be separated by non-stroke regions from 

continuous motions of the body along with user's writing motions in space. In other 
words, it can be stated that a stroked line is the trace of each stroke from the start to the 
end without any non-stroke region in the three-dimensional space. It is not easy to 

1 5 distinguish a portion of a stroke and a region of meaningless motion between two 

strokes from handwriting motions performed in the three-dimensional space. However, 
the system according to the present invention distinguishes strokes through stop motions 
intentionally performed before the start or after the end of each stroke by a user from 
handwriting motions in the three-dimensional space. 

20 [26] Obstacles such as hand-shivering exist in actual applications hindering 

detection of stop motions. While the hand-shivering problem appears to be solvable by 
a counter measure against the hand-shivering that defines a threshold value for 
acceleration measurement values and measuring whether measurement values smaller 
than the threshold value are maintained for a predetermined period of time, if a user 

25 turns the system in a different direction, the acceleration is measured to instantly 

approach to zero. At this time, if the acceleration smaller than the threshold value is 
maintained for the predetermined period of time, detection errors occur. Accordingly, it 
can not be stated that a region having the acceleration of nearly zero is a temporary stop 
region. Since it is difficult for a user to maintain the same acceleration for a certain 

30 period of time while making motions with the system, the control unit 140 applies the 

following conditions to detect temporary stops in the standard deviation for acceleration. 
[27] 1) For an instant time k, 
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[28] if q? a | (k) < a th for a time interval [k, k+H], at the time, the k is the start 

ki of a stroke. 
[29] 

[30] 2) For an instant time k > k x + W , 

5 [31] if q? a > <j th for a time interval [k, k+H], at the time, (k-S) is the end 

k2 of the stroke. 

[32] Herein, q? a ^{k) is a standard deviation for absolute acceleration |A n | for 

S samples just before the time k. a t h is a threshold value of the standard deviation for 
the |A n |. W is preset as a minimum time interval for writing one stroke. Further, the H 

10 is a minimum time interval for maintaining q? a ^(k) smaller than the threshold value o t h, 

and set in advance. It is noted here that the end of a stroke in (2) is not the k, but the (k 

- S) since q? a ^(k) is affected by the S samples just before the k. 

[33] Fig. 3 is a view for showing typical shifts of standard deviation versus 

detected accelerations, and acceleration magnitudes. Further, Fig. 3 shows enlarged 

1 5 portions that indicate the start and end of one stroke in writing motions in space. In Fig. 
3, 'A' is a line showing a standard deviation for 100 samples, 'B' is a line showing 
gravitational acceleration errors in accelerations of the system, and *C is a line showing 
errors between the standard deviation and the threshold value. In the enlarged portions 
of Fig. 3, the two sample intervals matching in magnitudes indicate regions where 

20 temporary stop motions have been performed by a user. 

[34] Fig. 4 is a view for showing simulation results in which a system 

recognizes and displays strokes as the pen-type input system of Fig. 2 is used for 
writing motions of 'samsung' in space. It can be seen that the intervals for pure strokes 
have somewhat higher acceleration changes and the intervals for temporary stop 

25 motions have nearly even accelerations. 

[35] As aforementioned, the space handwriting trajectory recognition 

techniques according to the disclosed teachings can distinguish and more precisely 
recognize stroked lines from handwriting motions in space, so that it can greatly reduce 
recognition errors and more clearly display users' intentions on a display unit or the like. 
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[36] While the invention has been shown and described with reference to a 

certain preferred embodiment thereof, it will be understood by those skilled in the art 
that various changes in form and details may be made therein without departing from 
the spirit and scope of the invention as defined by the appended claims. 
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